Universal Access To All Knowledge
Home Donate | Store | Blog | FAQ | Jobs | Volunteer Positions | Contact | Bios | Forums | Projects | Terms, Privacy, & Copyright
Search: Advanced Search
Anonymous User (login or join us)
Upload

Reply to this post | See parent post | Go Back
View Post [edit]

Poster: Administrator, Curator, or StaffJeff Kaplan Date: Jul 17, 2012 2:36pm
Forum: web Subject: Re: Question for Jeff regarding contradictory statements on web crawling policy

my bad. clicking "latest" will only capture that instance of that url. it does not as i suggested add it to a database for future crawling.

Terms of Use (10 Mar 2001)